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OO . Abstract 
(N 

\ We discuss the problem of separating consistently the total 

correlations in a bipartite quantum state into a quantum and 
a purely classical part. A measure of classical correlations is 
proposed and its properties are explored. 

Oh, In quantum information theory it is common to distinguish between 

I purely classical information, measured in bits, and quantum informa- 

' tion, which is measured in qubits. These differ in the channel resources 



required to communicate them. Qubits may not be sent by a classical 
channel alone, but must be sent either via a quantum channel which 
preserves coherence or by teleportation through an entangled channel 
^ I with two classical bits of communication In this context, one qubit 

I is equivalent to one unit of shared entanglement, or 'e-bit', together with 

two classical bits. Any bipartite quantum state may be used as a com- 
munication channel with some degree of success, and so it is of interest 
to determine how to separate the correlations it contains into a classical 
and an entangled part. A number of measures of entanglement and of 
total correlations have been proposed in recent years 0, |^, ||, H, |^ . How- 
ever, it is still not clear how to quantify the purely classical part of the 
total bipartite correlations. In this paper we propose a possible measure 
of classical correlations and investigate its properties. 

We first review the existing measures of entangled and total corre- 
lations. In classical information theory, the Shannon entropy, H{X) = 
Hip) = —J2iPi^'^&Piy is used to quantify the information in a source, 
X, that produces messages Xi with probabilities pi 0, ||. The relative 
entropy is a useful measure of the closeness of two probability distribu- 
tions {pi} and {qi} from the same source X. The relative entropy of 
{pi} to {qi} is defined as H{p\\q) = ^jPilog|^. Correlations between 
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two different random variables X and Y are measured by the mutual 
information, H{X : Y) = H{X) + H{Y) - H{X, Y), where H{X, Y) = 
— J2i j Pij logPij is the joint entropy and pij is the probability of outcomes 
Xi and yj both occurring. The mutual information measures how much 
information X and Y have in common. It may also be defined as a special 
case of the relative entropy, since it is a measure of how distinguishable 
a joint probability distribution pij is from the completely uncorrelated 
pair of distributions piPj, H{pij\\piPj) = H{pi) + H{pj) - H{pij). 

In a quantum context, the results of a measurement {Ey} on a state 
represented by a density matrix, p, comprise a probability distribution 
Py = Tr{Eyp). The Von Neumann entropy is a way of measuring the 
information in a quantum state by taking the entropy of the probability 
distribution generated from the state p by a projective measurement onto 
the state's eigenvectors ||^. It is defined as S{p) = —Tr(p log p) = H{X), 
where A = {Xi} are the eigenvalues of the state. The classical rela- 
tive entropy and classical mutual information also have analogues in the 
quantum domain. The quantum relative entropy of a state p with re- 
spect to another state a is defined as S{p\\a) = —S{p)—Tr{ploga). The 
joint entropy S{pab) for a composite system pab with two subsystems 
A and B is given by S{pab) = —Tr{pAB log pa_b) and the Von Neumann 
mutual information between the two subsystems is defined as 

I{Pa.b) = S{pa) + S{pb) - S{pab) 

As in the classical case, the mutual information is the relative entropy 
between pab and pa ® ps- The mutual information is usually used to 
measure the total correlations between the two subsystems of a bipartite 
quantum system. 

The entanglement of a bipartite quantum state pab may be quan- 
tified by how distinguishable it is from the 'nearest' separable state, as 
measured by the relative entropy. Relative entropy of entanglement, 
defined as 

Ere{pab)= min S{pAB\\<yAB) 

has been shown to be a useful measure of entanglement {D is the set 
of all separable or disentangled states) ^ ^. Note that Ere^Pab) < 
I{PA:b), by definition of Ere{pab), since the mutual information is also 
the relative entropy between pab and a completely disentangled state, 
/ = S{pab\\pa ® Pb) and so must be higher than the minimum over all 
disentangled states. 

Another way to measure the entanglement of a bipartite quantum 
state is to consider the process of formation of an ensemble of entangled 
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states 0. The ensemble is first prepared locally by Alice, then one 
subsystem is compressed using Schumacher compression [|10| and sent to 
Bob by teleportation. The entanglement of formation is then the amount 
of entanglement required for the teleportation. For pure states this is 
given by the compression efficiency, Ef{pab) = S{pb)- For mixed states, 
the entanglement of formation is Ef{pab) = niiiiX]jP«'S'(p^) < S{pb), 
where the minimum is taken over all decompositions of the mixed state. 
However, teleportation which requires only this much entanglement must 
be accompanied by classical communication of information about the 



decomposition of the mixed state |Tl| . The information in the subsystem 



S{pb) is thus split into a classical part and a quantum part. The classical 
part may be transmitted by a classical channel, but the quantum part 
requires entanglement and is sent by teleportation. 

There has been some work on the general problem of splitting in- 
formation in a particular quantum state into a classical and a quantum 
part fl^. Consider performing a general measurement on the state, 

A]Ai, such that Pr = ^f^^U, ■ The final state of subsystem B is then 
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iPiPs- The entropy of the residual states is Y^iPi^^P 
The classical information obtained by measuring outcomes i with proba- 
bilities Pi is H{p). If the states have support on orthogonal subspaces, 
then the entropy of the final state is the sum of the residual entropy and 
the classical information S{J2iPiPB) = H{p) + J^iPi^iPB)- It ^las been 
shown that the state ps = JZiPiPh can be reconstructed with arbitrarily 
high fidelity from the classical measurement outcomes and the residual 
states if and only if the residual states are on orthogonal subspaces 



12| . We see then that the information in a quantum state may be split 
into a quantum and a classical part. 

We now ask how this can be done for correlations between two subsys- 
tems. We would like a way to measure the classical correlations between 
two subsystems. We first suggest four reasonable properties we should 
expect a measure of classical correlations, C, to satisfy. 



1. C = for p = p^ p^. This requires that product states are not 
correlated. 

2. C is invariant under local unitary transformations. This is because 
any change of basis should not affect the correlation between two 
subsystems. 

3. C is non-increasing under local operations. If the two subsystems 
evolve independently then the correlation between them cannot 
increase. 
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4. C = S{pa) = S{pb) for pure states. This is a natural requirement, 
as we will see below. 



Note that (2) and (4) are also required of a measure of entanglement. 
If classical communication were added to (3), it would be identical to the 
corresponding condition for entanglement measures. However, if classical 
communication is allowed, then the classical correlations could increase 
as well as decrease, which is not satisfactory. It is also natural that the 
measure C should be symmetric under interchange of the subsystems 
A and B. This is because it should quantify the correlation between 
subsystems rather than a property of either subsystem. However, we 
do not include this as a separate constraint as it is not clear that this 
condition is independent from (1) — (4). 

We now suggest a measure which satisfies these properties. The 
proposed measure is: 

Cb{pab) = maxS{pA) - y'pi5(p^) (1) 

where BjBi is a POVM performed on the subsystem B and p\ = 
trB{BiPABB\) /trAB{BiPABB\) is the remaining state of A after obtain- 
ing the outcome i on B. Alternatively, 

Ca{pab) = raax S{pb) - V'pi5'(p^) (2) 

if the measurement is performed on subsystem A instead of on i?. Clearly 
Ca{pab) = Cb{pab) for all states pab such that pA = Pb- It remains 
an open question whether this is true in general. The measure is a 
natural generalisation of the classical mutual information, which is the 
difference in uncertainty about the subsystem B (A) before and after a 
measurement on the correlated subsystem A (B), H{A : B) = H{B) — 
H{B\A). Similarly, Eq.s (|lD and (H) represent the difference in Von 
Neumann entropy before and after the measurement. Note the similarity 
of the definition to the Holevo bound which measures the capacity of 
quantum states for classical communication ||13| ]. 



The following example provides an illustration. Consider a bipartite 
separable state of the form 



Pab = X^Pi (^U ® Pb 



where are orthonormal states of subsystem A. Clearly the entan- 
glement of this state is zero. The best measurement that Alice can make 
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to gain information about Bob's subsystem is a projective measurement 
onto the states of subsystem A. Therefore the classical correlations 
are given by 

Ca(pab) = S{pb) - ^PiS{pB) 

i 

For this state, the mutual information is also given by 

I{PA:b) = S{pb) - ^P^S{pB) 

i 

This is to be expected since there are no entangled correlations and so 
the total correlations between A and B should be equal to the classical 
correlations. 

We now investigate the properties of the quantities in Eq.s (P and 
(0). Property (1) above is clearly satisfied, since the state of subsystem B 
corresponding to any measurement result i on subsystem A is still pb for 
a product state. In fact, C{pab) = if and only if pab = Pa® Pb- Prop- 
erty (2) is satisfied since the Von Neumann entropy is invariant under lo- 
cal unitary transformations. Property (4) is also satisfied, since for pure 
states Ca{pab) = S{pa) {Cb{pab) = S{pb) = S{pa) = Ca{pab)) can 
always be achieved by local projection onto the Schmidt basis. Therefore 
for pure states E{pab) = C{pab) and I{pa:b) = 2E{pab) = 2C{pab) 
(here E{pab) may be either Eb_e{.Pab) or Ef{pab) since these measures 
coincide for pure states). The most important property required of a 
measure of classical correlations is that it is non-increasing under local 
operations (property (3)). We now show that this property is satisfied 
by the proposed measure. 

Property (3): The measure Ca (Cb) is non-increasing under local 
operations. 

Proof: Let {AjAi : M^i = ^} be the POVM which maximises 
Ca = max^t^^ sIpb) - Y.iViS{,P%) = max^t^^ J2iPiSM\PB)- 

a) Consider a local operation (pA on subsystem A. This may be 
regarded as part of the POVM on A so Ca, being a maximum is not 
affected. 

b) Now take a local operation 0^ on subsystem B. Then by the prop- 
erty that the relative entropy does not increase under local operations, 
J2iPiS{pB\\PB) > Y^iPiS{4>B{ph)\\(t>B{pB)) 13- Therefore Ca does not 
increase under local operations. 

We now consider the relations between the classical, total and en- 
tangled correlations in some simple cases. These raise some interesting 
general questions. 
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Figure 1: Correlations for a mixture of two Bell states, pab = 
pI^"*") (0+1 + (1 — p) 10^) (0^1, as a function of p. 



First, consider a maximally entangled pure state, |0+)(0+|, and the 
family of states that interpolate between it and its completely decohered 
state |00) (00 1 + |11) (11 1. These are states of the form 

PAB=p|0+>(0+| + (l-p)|0->(0l 

where ^ < p < 1. The mutual information as a function of p is I{pa:b) = 
2 + plogp + (1 — p) log(l — p). The entanglement is Ere{pab) = 1 + 
plogp+ (1 — p) log(l — p) However the classical correlations remain 
constant at Ca{pab) = Cb{pab) = C{pab) = 1- This is achieved by a 
projective measurement onto {|0) (0|, |1) (1|}, and must be the maximum 
because C cannot exceed one. For this example, the total correlations 
are just the sum of the entangled and the classical correlations, I{pa:b) = 
Ere{pab) + C{pab), see Fig. (|1]). 

We now consider a Werner state of the form 

P^B=p|0+> (0+1 + ^/ 

with I < p < 1. The mutual information is given by I{pa:b) = 2 + 
/log / + (1 — /)log(^^), where / = The relative entropy of 

entanglement is Er^; (pas) = l + /log/+(l-/) log(l-/) @]. The state 
is symmetric under interchange of subsystems A and B, so Ca{pab) = 
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Figure 2: Correlations for a Werner state, pab = P \4>^) {4>^\ H — as 
a function of p. 



Cb{pab) = C{pab)- Any orthogonal projection produces the same value 
for the classical correlations. We call this quantity Cp{pAB)- Clearly 
Cp{pab) < C{pab)- These quantities are plotted in Fig. (|^). 
Consider now a state of the form 

PAB=p\om{om + {i-p)\+)\+){+\{+\ 

Again, the state is symmetrical with regard to A and B, so Ca{pab) = 
Cb{pab) = C{pab)- This state provides a simple example where the 
states on both sides are non-orthogonal. In this case, the optimal single- 
shot measurement for distinguishing the two states |0) and |+) with 
respect to probability of error is known |jl5|. However interestingly it 



is not the measurement which optimises the classical correlations. We 
optimise over all orthogonal measurements and call the resulting quan- 
tity Cp{pab)- This is plotted in Fig. (^), together with the mutual 
information. 

In these last two examples, we see that Cp{pAB) + Ehe^Pab) < 
I{PA:b)- If the classical correlations are maximised by an orthogonal 
measurement on one subsystem, {Cp{pAB) = C{pab)), the classical and 
entangled correlations do not account for all the total correlations. This 
may indicate that the quantum mutual information is not the best quan- 
tity for measuring total correlations, or that correlations are simply not 
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Figure 3: Correlations for the separable state, pab = p|0)|0)(0|(0| + (1 — 
^ ^ function of p. 



additive in this sense. However, Cp{pAB) may not coincide with C{pab)- 
It is also possible that an asymptotic measurement on many copies of 
the state would achieve a higher value for the classical correlations than 
measurements on a single copy. This is because the classical correlations 
are super-additive, C{p® p) > 2C{p). It is interesting to note that on 
the other hand, entangled correlations, as measured by E^ie Ep, are 
subadditive, E{p ® p) < 2E{p), and total correlations, measured by the 
mutual information, are additive I{p ® p) = 2/(p). 

A number of interesting questions are raised about the general re- 
lations between /, E and C. We do not know whether the sum of the 
two types of correlations is generally greater than, less than or equal 
to the total correlations, when asymptotic measurements are taken into 
account. For mixed states, we saw that it need no longer be true that 
E{pab) = C{pab), as it is for pure states. This raises the question of 
whether E{pab) = C{pab) if and only if pab is pure. In our exam- 
ples we found E{pab) < C{pab), and we conjecture that this is gen- 
erally true. We know that Ere^Pab) < I{pa:b)- Is it also true that 
C{pab) < Hpa:b) in general? 

Another possible measure of classical correlations could be based on 
the relative entropy, just as measures of total and entangled correlations 
are both relative entropies, I{pa:b) — S{pab\\pa ® Pb), and E{pa:b) — 
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min^^g^D S{pab\Wab) @, 0]- Classical correlations could then be given 
by the relative entropy between the closest separable state, cr^^, and the 
product state pA <S) ps, Cre = S{a\Q\\pA ® Pb)- For the example of a 
mixture of two Bell states, Cre{pab) coincides with C{pab) = 1- For the 
separable state pab = p|0) |0) (0| (0| + (1 - Cre{pab) = 

I{PA:b)i which makes sense intuitively since there is no entanglement. 
However, for Werner states, the relative entropy of classical correlations 
remains constant at Cre{,Pab) = 0.2075. Therefore for low values of p, 
Cre{pab) > Ere{pab), whereas for high values, Cre{pab) < Ere{pab)- 
In general I{pa:b) > Cre{pab) + Ere{pab), so that the two types of 
correlations do not sum to the total. It also remains to be proved whether 
Cre is non-increasing under local operations. 

In this paper we have raised the question of how to quantify the 
purely classical part of a correlated quantum system, and we have sug- 
gested a potential candidate for a measure which satisfies the most im- 
portant property of being non- increasing under local operations. A num- 
ber of interesting open questions about the relationship between mea- 
sures of classical, entangled and total correlations have been raised. It is 
hoped that a quantitative understanding of the different types of corre- 
lations would aid our understanding of protocols involving manipulation 
of entanglement and classical information. In particular it should shed 
some light on the conversion from entanglement to classical information 
which occurs in the process of quantum measurement. 
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